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Efficien t intra-dg^ain ro uting in packet-switched network s,. 

The invention relates to a method, an edge router and an internal 
router for routing data packets in a packet-switched network with 
5 traffic distribution 

An important area of work for network technicians, and routing and 
internet experts, is the further development of packet-switched 
networks. An important objective of this further development is to be 
10 able to offer a comprehensive spectrum of services over packet-switched 
networks . 

Apart from the conventional applications for data transmission, ever 
more services with real-time requirements, such as telephone (e.g. 

15 Voice over IP) and the transmission of image data in real time (e.g. 
video on demand, video conferences) , are to be realized over packet- 
switched networks. From this arise new requirements which the packet- 
switched networks must meet. Adherence to quality characteristics for 
services with real-time requirements - frequently referred to in this 

20 context as the 'quality of service', abbreviated to QoS - is of central 
importance . 

The packet-switched networks which are currently most popular are based 
on the IP (Internet Protocol) protocol. The success of these is to a 
25 large extent explained by their comparatively low complexity and high 
flexibility. Both of these arise from the way that packets are 
forwarded in the IP network. 

Within IP networks, the packets are routed by reference to their IP 
30 addressed. In the large majority of cases, the routing is effected on a 
per-hop basis, i.e. by reference to the packet address the routers 
identify a destination, normally another router, to which the packet 
concerned is forwarded. At the end of the transmission 
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via a chain of routers, the packet is delivered to the destination 
address, often a host or a gateway. 

In general, no information relating to the transmission path is 
5 available to an individual router apart from details of the next hop or 
the next stage, as applicable. As a result, the maintenance and 
administration of the routing tables requires little effort. In 
addition, the method is flexible to the extent that alternative and 
default destinations can be provided for the next hop which, for 
10 example, ensure that the packet can be forwarded in the event of a 
malfunction or unknown addresses. 

IP networks using conventional routing techniques are not very suitable 
for real-time traffic. Delays to packets, and their loss, are not 
15 subject to sufficiently stringent controls ,to be able to guarantee the 
quality characteristics necessary for real-time transmission. 

Methods for better control of the transmission parameters include the 
reservation of transmission capacity for services with real-time 

20 requirements, and the specification of transmission paths in the 

network. The RSVP (Resource Reservation Protocol) signaling protocol 
was developed for the purpose of ' reserving bandwidth in IP networks. 
The RSVP protocol is used with, among others, the MPLS (Multi -Protocol 
Label Switching) protocol which permits the transmission path to be 

25 defined. The MPLS protocol provides for a packet, when it enters into a 
network, to be allocated a label by an LSR (Label Switching Router) 
edge router, which defines an LSP (Label Switched Path) path through 
the network. The packet is then forwarded by internal LSR (Label 
Switching Router) routers according to the LSP path defined by the 

30 label. 

A choice of path is also made as part of the ATM (Asynchronous Transfer 
Mode) technique, and for IP networks can also be effected 
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by means of the Source Route Option of the IP datagram (although in 
practice this is seldom supported) . 

The reservation of paths permits guarantee statements in respect of a 
5 QoS transmission, but is associated with high complexity and the loss 
of flexibility (by comparison with "best effort" packet-switched 
networks) . 

The object of the invention is < efficient routing in terms of a QoS 
10 transmission over a packet-switched network, while avoiding the 
disadvantages of conventional methods. 

This object is achieved by a method according to Claim 1, an edge 
router according to Claim 16, and an internal router according to Claim 
15 17. 

As part of the invention, a method is proposed for the routing of data 
packets in a packet-switched network with traffic distribution. With 
this method according to the invention, a data packet is forwarded or 

20 routed, as applicable, by an internal router within the data network, 
with the forwarding or routing respectively of the packet being 
effected by reference to at least two items of data. One of these two 
items of data is the interface or node, as applicable, where the data 
packet came into the packet-switched network, and the second item of 

25 data is the interface or node, as applicable, where the data packet is 
to leave the data network. By contrast with conventional methods, such 
as the ATM technology or the MPLS technology, no complete path through - 
the packet-switched network is defined. The only items fixed are the 
point at which the data packet accesses the network, and the point or 

30 interface where the data packet leaves the data network again. Within 
the packet -switched network use is made of traffic distribution. That 
is to say, for example, that alternatives are prescribed for routers to 
use in forwarding data packets, which they can use for the routing, for 
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example if a link goes down or as part of a statistical distribution 
over alternative paths. For the definition of ingress 
or egress points for data packets (i.e. the interfaces at which the 
data packets respectively come into the network or leave the network 
5 again) , identifiers can be issued, for example, at edge nodes or ports 
of edge nodes, as applicable. An identifier of this type would then 
indicate respectively the node or the port of the node, at which the 
data packet comes into the packet-switched network or is to leave the 
packet-switched network, as applicable. 

10 

Here, the term internal router or internal node is relative to the 
forwarding of the data packet through the packet-switched network, and 
includes all the routers or nodes, as applicable, which are not 
identical with the entry or exit nodes. The set of routers which have 

15 interface functions with respect to other networks, and topologically 
are located on the edge of the network, are called edge routers. The 
complementary routers are then called core routers. In the context of 
this terminology, the term internal router is not identical with core 
router. If, for example, the path of the data packet when it is routed 

20 through the packet-switched network passes through several core 
routers, only those two core routers at which the data packet 
respectively enters and leaves the network are also internal routers in 
the sense of the description. 

25 In the case of the packet-switched network, it can also be a partial 

network or subnetwork. In IP (Internet Protocol) systems there are, for 
example, network architectures in which the network as a whole is 
subdivided into networks called * autonomous systems". The network 
according to the invention could be, for example, an autonomous system 

30 or that part of the whole network which lies within the area of 
responsibility of a service provider (e.g. ISP: internet service 
provider) . In the case of a subnetwork, service parameters can be 
defined for transmissions through the whole network, by traffic control 
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within the subnetworks and efficient communication between the 
subnetworks . 

In a packet-switched network, traffic distribution is exercised. With 
5 this, routers in the data network can distribute traffic to alternative 
next stations or hops, as applicable. This distribution 

can be effected, for example, for each packet or for each flow. Routing 
via alternative routes or paths, as appropriate, can be exercised in 
the event of the failure of connecting links or with the object of a 
10 more uniform distribution of the data traffic. The invention permits 
local decisions about the forwarding of data packets by reference to 
data about the entry and exit points. In general, the paths of data 
packets are not rigidly defined when they enter into the packet- 
switched network. 

15 

The invention has the advantage of greater flexibility compared to 
methods which provide for the complete definition of the transmission 
path. Access controls at the edge of the network can be used to ensure 
that the traffic incidence within the network remains within limits 
20 which permit transmissions with the QoS level. By means of traffic 
distribution within the network, it is possible to ensure that no 
bottlenecks arise on individual links. Problems of conventional packet- 
switched networks, such as the circulation of packets, are avoided. 

25 The involvement of data about the origin in a router's forwarding 

decision makes it possible to permit a greater diversity of paths than 
with classical IP routing or ECMP (equal cost multipath) . The 
associated -increase in the complexity of the routing tables is kept 
small in a network by the reduction of the routing tables to data 

30 relating to the entry and exit points (e.g. the ingress and egress node 
numbers) ; the resulting routing tables will generally be smaller than 
with classical IP routing. "In contrast to MPLS, no explicit 
construction of paths is required, and all the network components can 
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autonomously exploit the path diversity, to achieve a distribution of 
the traffic or fast local reaction to faults. 

Three possibilities for supplying the internal routers with the data 
5 about the entry and exit points are sketched out below. 

For example, at the entry point the data packet can be provided with 
one of more data fields or labels, as appropriate, containing the data 
relating to the entry and exit points for the data packet. This data 

10 field or fields, as applicable, can be prepended or attached to the 

data packet as a header or trailer respectively. Here, a data field can 
either contain the information about both the entry point and the exit 
point, or alternatively there can be a separate data field each for the 
data about the entry point and the exit point respectively. A bit 

15 sequence can be prefixed to the data fields or labels, as applicable, 

to identify them as such. One option is to make use of MPLS labels, and 
to issue an MPLS label for each pair of ingress and egress nodes. For 
each of the labels, various alternative paths within the data network 
will then be defined. For the routing within the network, the internal 

20 router can then identify the label and make local decisions about which 
of the paths associated with the label to forward the data packet 
along. Logically, data packets in an end-to-end flow, i.e. data packets 
with the same origin and destination address data (e.'g. IP addresses 
and possibly TCP port numbers) will be routed along the same path, in 

25 order to maintain the sequence of the data packets . 

Data fields which were added to the data packet at either an ingress 
node or ingress router to the data network, as applicable, can be 
removed again at the egress point or egress router, as applicable. For 
.30 example, routing tables can be maintained in the internal routers, 

defining a relationship between the data about the data packet's access 
interface and the data about the egress interface, on the one hand, and 
an address for the forwarding of the data 
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packet. A table of this sort then comprises, for each pair of access 
and egress interfaces, the address of the next hop for the data packet. 
In addition to this, further alternative addresses can be arranged in 
the table, for use in traffic distribution or as a backup in the event 
5 of malfunctions or delays on one of the outbound links from the 

internal router. Instead of classically organized tables, it is also 
possible to perform a search using modern search structures and 
algorithms which, for example, proceed according to a tree structure. 

10 Another option for communicating to the internal router the data about 
the access interface or egress interface for the data packet is to make 
use of existing unused fields in the data packet. For example, the use 
of the source-route option of an IP datagram for storing address data 
for the data packet's ingress and egress interfaces is conceivable. 

15 These items of data would then be written into the datagram on its 
entry into the network, and then extracted from the datagram by the 
internal node in the course of the routing decision. The data about the 
access interface or egress interface, as applicable, could then be 
removed again from the fields in the data packet when it leaves the 

20 network, so that these fields are then available again for their 
original purposes. 

A third possibility is that the internal nodes identify the access 
point and the designated egress point for the data packet by reference 
25 to address data extracted from the data packet. 

It is also possible to use an approach to the determination of the data 
about the interface at which the data packet accesses the packet- 
switched network and the data about the egress interface, at which the 
30 data packet is to leave the data network, which differs for the ingress 
and egress points. 
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For example, when a packet enters the network the packet can be 
provided with a data field containing the identifier of the entry node. 
The internal router then extracts this identifier and, for example, 
uses a table to determine the egress node. Other combinations of 
5 different procedures, for determining the two items of data relating to 
the ingress interface and the egress interface, are also possible. 

The invention is explained in more detail below in the context of an 
exemplary embodiment, by reference to figures, in which: 

10 

Figure 1 shows a simplified representation of a packet-switched network 

Figure 2 shows conventional routing tables for the typical network 
shown in Fig.l 

15 

Figure 3 shows a schematic diagram of how labels are used according to 
the invention 

Figure 4 shows routing tables according to the invention 

20 

Fig.l shows a simplified representation of a packet-switched network 
Nl . Connected to the packet-switched network Nl are the networks N2 to 
N4 . The networks N1-N4 allow the subscriber stations or terminal 
devices T1-T9 to communicate with each other. Here, there are three 

25 terminal devices connected to each of the networks N2 , N3 and N4 (TI- 
TS, T4-T6 and T7-T9). The packet-switched network Nl incorporates the 
nodes Kl, K2 and K3 , which are connected to each other via the 
connecting lines or links, L12, LI 3, L23. The uppermost table in Fig. 2 
specifies two paths for each of the various pairs of origin and 

30 destination networks. The first path specified represents the preferred 
path for a routing, which is aimed at the (minimal) number of 
intermediate stations or hops, as applicable. The second path 
represents in each case an alternative path which, for example, can be 
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used as a substitute in the event of malfunctions or bottlenecks. By 
way of example, consider a data transmission from the network N2 to the 
network N3 . The "least cost" path goes via the nodes Kl and K2 . The 
alternative path avoids the link L12 by providing a forwarding chain 
5 K1-K3-K2. This alternative path will be used, for example, if the link 
L12 goes down. 

The second to fourth tables in Fig. 2 show conventional routing tables 
in the nodes Kl, K2 and K3 . For a particular destination, each table 

10 shows the next station or hop, as applicable, and an alternative, 

corresponding to the paths specified in the uppermost table. As shown 
by the routing table in node Kl, data packets addressed to the network 
Nl can be communicated directly (locally) to the connected network Nl . 
This situation is represented in the table by the fields containing the 

15 term "local". Data packets directed to the network N3 are preferably 

routed on to the node K2 . As an alternative destination, the node K3 is 
tabulated. In an analogous way, data packets directed to the network N4 
are preferably routed to the node K3 , and alternatively to the node K2 . 
The routing tables for nodes K2 and k3 are to be interpreted 

20 correspondingly . 

This combination of routing tables would permit, for example, a data 
packet which is sent from the network N2 to the network N3 and which 
enters the network Nl at node Kl to be passed on initially to the node 

25 K3, and by this latter to then be passed back to the node Kl . Such 

cases can arises, for example, with load balancing for the purpose of 
improved utilization within the packet-switched network Nl over the 
preferred and alternative paths. If, for example, data packets 
basically have an eighty percent probability of being routed along the 

30 preferred path and a twenty percent probability of being routed via the 
alternative path, then this situation occurs with a probability of 0.2 
* 0.2 * 100 = 4%. I.e. loops occur. Loops must particularly be avoided 
if traffic restrictions and traffic controls 
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in respect of QoS guarantees are applied at the boundaries of the 
packet-switched network Nl . 

Using classical IP routing, which only takes into consideration the 
5 destination address of a packet, this problem cannot be solved without 
restricting the path diversity. In the present example, it would be 
necessary to remove the alternative paths for at least two of the nodes 
in order to guarantee loop- free forwarding. This is at the same time 
the maximum path diversity which can be achieved using such mechanisms 
10 as ECMP (equal cost multipath) with manual setting of the cost 

parameters, or using the EIGRP (enhanced interior gateway routing 
protocol) and unequal cost multipath routing. 

One option for getting round the destination-based routing is the 
15 presetting of the transmission path, e.g. as part of the MPLS concept. 
In this case, a number of bits (a "label") are prefixed to each IP 
packet, giving a path reference. However, MPLS has the disadvantage 
that the original choice of path made by the. router at the ingress 
point to the network (the "ingress router") cannot then be modified by 
20 subsequent nodes on the path. 

Fig. 3 illustrates the method according to the invention using data 
fields or labels for routing with the packet-switched network Nl . It 
shows the packet-switched network Nl together with the networks N2 and 

25 N3 . A data packet which is to be transmitted from network N2 to network 
N3 is modified at node Kl, i.e. at its ingress router. The labels EL 
(for Egress Label) and IL (for Ingress Label) are attached as a header 
to the data packet. The label IL includes an identifier for the ingress 
router and the label EL includes an identifier for the egress router, 

30 at which the data packet is to leave the network again. . As an option, 
an additional bit sequence LC* (LC for label code) can identify the 
labels IL and EL as such. Fig. 3 shows schematically an IP packet with 
such labels EL, IL and 
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LC, which' are added when the data packet enters the network Nl at node 
Kl and are removed again when it leaves the network Nl at node K2 . 

The contents of the labels EL and IL are:' for IL the number of the node 
5 Kl and for EL the number of the node K2 . These node numbers can be 

issued, for example, during installation of the network nodes, so that 
within any packet-switched network or autonomous system (the latter, 
expression is frequently encountered in English-language literature) 
which is under consideration they are in each case unique. Each ingress 

10 node to the network can use its own node number as the IL label. The 
node number of the egress node or the label EL, as applicable, can be 
determined by reference to classical packet-switched network routing 
data, e.g. the destination IP address recorded in the packet. The node 
number thus determined for the egress node will then be used as the 

15 label EL. 

Within the network it is now no longer necessary to consider the origin 
and destination addresses in the header of the data packet. The next 
node can be determined solely by reference to the data fields IL and EL 
20 (or a single combined label) prefixed to the packet. By this means, the 
routing tables are substantially reduced in size. Furthermore, by 
combining the data fields IL and EL to form a pseudo MPLS label, the 
communication format of the packets could be kept compatible with MPLS. 

25 Fig. 4 shows routing tables according to the invention for the example 
shown in Fig. 1. To the nodes Kl , K2 and K3 are assigned the node 
numbers or node identifiers, as applicable, KN1, KN2 and KN3 . An 
ingress node, for example node Kl, then uses its own node number, i.e. 
KN1 for node Kl , -for the label IL. The node identifier for the label EL 

30 is determined by reference to a table. Each network node in Nl which is 
connected to external networks then has a table for use in determining 
the egress node. An example of such a table is given 
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by the uppermost table in Fig. 4. When a data packet is transmitted 
from the network N2 to the network N3 , the ingress node Kl extracts 
from the aforementioned table in Fig. 4 the node number KN2 for the 
egress node K2 . The node number KN2 is then used for the label EL. In 
5 the table, the networks N2 , N3 and N4 each stands for its network nodes 
and all the further networks which can be reached through it. The 
tables for determining the EL have roughly the size of a BGP routing 
table (BGP: Border Gateway Protocol) . Correspondingly, the search 
effort to determine a label EL will also be of a similarly moderate 
10 level as for the determination of a next-hop router using the BGP 
protocol . 

The other tables in Fig. 4 are the analogs of the routing tables in 
Fig. 2 for the method according to the invention. The routing tables 

15 now have one entry for each ingress/egress node pair. If the packet is 
to leave the network Nl at one of the nodes, the label is removed again 
and the next node is determined using the external routing protocol (in 
the literature the expression exterior gateway protocol, abbreviated to 
EGP, is common) . The BGP (border gateway protocol) is often used for 

20 this purpose. For example, suppose a data packet is sent from the 

network N2 to the network N3 . The ingress node Kl determines the egress 
node K2 , and prefixes the identifiers KN1 and KN2 of the ingress and 
egress nodes to the data packet as a label. According to the routing 
table for the node Kl in Fig. 4, for the egress /ingress label pair KN2 

25 and KN1 the preferred next node is K2 . As an alternative, the data 

packet is routed to the node K3 . In the first case - as stipulated in 
the third table in Fig. 4 - the next hop will be determined by node K3 
using an EGP protocol (here, the asterisk is a dummy which stands for 
any arbitrary node identifier) . In the second case - lowermost table in 

30 Fig. 4 - node K3 determines the node K2 as the next hop. There is no 
alternative hop or alternative address, as applicable. A loop is 
thereby avoided. 
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The node numbers can be issued manually when network nodes are 
installed. However, preference should be given to automated mechanisms. 
For this purpose, a protocol can be executed between the routers, by 
which they autonomously reach agreement on their node numbers (for 
5 example by reference to the sequence of their IP addresses in the 

network under consideration) and then distribute amongst themselves the 
tables for determining the egress label EL. If new nodes are inserted 
into a network which is currently in operation, they can each be given 
the next unallocated node number. In order to manage the process of 
10 combining previously separate networks which are currently in 
operation, further mechanisms are generally required. 

One alternative to automatic self -configuration is configuration by a 
central station, for example as part of the network management 
15 procedures. To this end, a network can initially be started up in the 

normal IP routing mode. The node numbers are then issued by the network 
management procedures, and only then are the processes for attaching 
the labels and distributing the traffic across several paths started 
up. 

20 

In order to ensure that the free distribution of packets over various 
paths does not disrupt any sequence of packets which belong together 
semantically (for example packets for the same TCP link) , a node at the 
network ingress can add to the label a further field, FI (flow 

25 identifier) , containing for example a value calculated from the origin 
and" a destination addresses for the packet "(e.g. IP addresses and any 
port numbers) . Subsequent nodes in the network must then either note in 
a dynamic table the path decision made for each value of the field FI, 
or must assign the FI values to particular routes in a systematic way 

30 (for example by splitting up the value range of FI) . In the event of 
faults, the association between FI and path decision can be changed 
locally and dynamically at each node. 
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Using algorithms, the routing tables can either be calculated centrally 
and distributed to all the nodes, or they can be calculated 
autonomously in each node, for example using the link-state data 
exchanged with the help of the OSPF (Open Shortest Path First) 
5 protocol. 

The method described can also be used without the communication of 
ingress/egress numbers in labels. To do this, two further tables are 
provided in each network node, using which it can calculate for itself 

10 the appropriate data for each packet. In this case, the EL table 

corresponds to the EL table explained above by reference to Fig. 4. A 
corresponding IL table can be created in the same way from the external 
(EGP) routing tables if symmetric routing is ensured in the EGP. Here, 
symmetric routing means that the path of data packets is invariant with 

15 respect to the direction of transmission, i.e. unaffected by swapping 
the origin and destination addresses in the header of the data packet. 
In creating an IL table, a relationship is set up between the origin 
addresses and the access interface or access node, as applicable. The 
access interface is determined for a particular data packet by using 

20 the EGP to determine the egress interface or egress node, as 

applicable, of data packets for which the destination address is the 
same as the origin address for the particular data packet. Due to the 
symmetry of the routing, the interface or node determined in this way 
will be the ingress interface or ingress node, as applicable, of the 

25 data package. 

On grounds of security it is in any case often desired to check whether 
the origin address of an IP packet at its ingress into a network is in 
agreement with the physical ingress point, so this requirement for 
30 symmetrical routing may well be satisfied in future as a matter of 
course . 
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The concept can also be realized with only an ingress label IL. In this 
case the local routing tables would contain, instead of the egress 
label EL, the usual network addresses, and would be corresponding! y 
larger, but the network ingress nodes would be saved from the need to 
look up the egress labels. 



